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SYSTEM AND METHOD FOR REDUCING 
THE FOOTPRINT OF PRELOADED 
CLASSES 

The present invention relates generally to a class pre- 
loader and, particularly, to a system and method for reducing 
the size in read only memory of preloaded Java classes. 

BACKGROUND OF THE INVENTION 

A Java program comprises a number of small software 
components called classes. Each class contains code and 
data and is defined by information in a respective class file. 
Each class file is organized according to the same platform- 
independent "class file format". Referring to FIG. 1, there is 
shown a block diagram of the class file format, according to 
which each class file 400 includes header information 402, 
a constant pool 404, a methods table 406 and a fields table 
408. The header information 402 identifies the class file 
format, the size of the constant pool, the number of methods 
in the methods table 406 and the number of fields in the 
fields table 408. The constant pool 404 is a table of structures 
representing various string constants, class names, field 
names and other constants that are referred to within the 
class file structure and its sub-structures. The methods table 
406 includes one or more method structures, each of which 
gives a complete description of and Java code for a method 
explicitly declared by the class. The fields table 408 includes 
one or more field structures, each of which gives a complete 
description of a field declared by the class. An example of 
the fields table 408 is now described in reference to FIG. IB. 

A Java program is executed on a computer containing a 
program called a virtual machine (VM), which is respon- 
sible for executing the code in Java classes. It is customary 
for the classes of a Java program to be loaded as late in the 
program's execution as possible: they are loaded on demand 
from a network server or from a local file system when first 
referenced during the program's execution. The VM locates 
and loads each class, parses the class file format, allocates 
internal data structures for its various components, and links 
it in with other already loaded classes. This process makes 
the method code in the class readily executable by the VM. 

For small and embedded systems for which facilities, 
required for class loading, such as a network connection, a 
local file system or other permanent storage, are unavailable, 
it is desirable to preload the classes into read only memory 
(ROM). One preloading scheme is described in U.S. patent 
application Ser. No. 08/655,474 ("A Method and System for 
Loading Classes in Read-Only Memory"), which is entirely 
incorporated herein by reference. In this method and system, 
the VM data structures representing classes, fields and 
methods in memory are generated online by a class pre- 
loader. The preloader output is then linked in a system that 
includes a VM and placed in read-only memory. This 
eliminates the need for storing class files and doing dynamic 
class loading. 

Referring to FIG. 2 A, there is shown a more detailed 
block diagram of the VM data structures 1200,generated by 
the class preloader. The data structures 1200 include a class 
block 1202, a plurality of method blocks 1204, a plurality of 
field blocks 1214 and a constant pool 1224. 

The class block 1202 is a fixed-size data structure that can 
include the following information: 

the class name 1230; 

a pointer 1232 to the class block of the current class's 

immediate superclass; 
a pointer 1234 to the method blocks 1204; 
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a pointer 1236 to the field blocks 1214; and 
a pointer 1238 to the class' constant pool; 
The elements of a class block data structure are referred 
to herein as class block members. 

5 A method block 1204 is a fixed-sized data structure that 
represents one of the class's methods. The elements of a 
method block data structure are referred to herein as method 
block members. A field block 1214 is a fixed-size data 
structure that represents one of the class's instance variables. 

10 The elements of a field block data structure are referred to 
herein as field block members. 

Each type of VM data structure, including the class block 
1202, method blocks 1204, field blocks 1214 and constant 
pool 1224, has a format defined by a corresponding data 

15 structure declaration. For example, a single method block 
declaration defines the format of all method blocks 1204. 
The data structure declarations also define accessor func- 
tions (or macros) that are used by the VM to access data 
structure members. These data structure declarations are 

20 internal to the VM and are not used by class components. 
The prior art data structure declarations are now described in 
reference to FIG. 2B. 

Referring to FIG. 2B, there is shown a depiction of data 
structure declarations 1230 that define the format of all data 

25 structure types employed by a particular VM. Each decla- 
ration 1230 includes a set of member declarations 1232 and 
accessor functions 1234 for accessing respective members. 
The member declarations 1232 and accessor functions 1234 
are defined conventionally, according to the syntax of the 

30 language used in the implementation of the VM. For 
example, assuming the C language is used in the data 
structure declarations 1230, a generic field data structure 
1230. N (shown in FIG. 2B) could be defined as a structure 
T with five members of the following types with respective 

35 accessor functions: 



40 



member name 


member type 


accessor functions 


member] 


mtypel 


mem] of (T) T->memberl 


membefZ 


mtype2 


mem2 of (T) T->member2 


member3 


mtype3 


mem3 of fT) T->member3 


member4 


mtype4 


mem4 of fT) T->member4 


memberS 


mtypeS 


memS of fT) T->member5 



45 

In this example, the member types can be any type defined 
by the relevant computer language, including user defined 
types or language types, such as integer, float, char or 
double. The accessor functions are macros used by the VM 

50 to access the fields without needing to access directly the 
structure containing the field. For example, instead of 
employing the expression (< T-»memberl" to access fieldl in 
structure type T, the VM need only employ the expression 
"meml of (1)". Accessor functions are well known in 

55 programming languages, such as C, that provide sophisti- 
cated data structure capabilities. 

The internal data structures used to store "class meta data" 
(i.e., the class, method and field blocks 1202, 1204, 1214) 
require large, fixed amounts of space in read-only memory. 

60 In fact, measurements indicate that this sort of class meta 
data often takes up much more space than the bytecodes for 
the class methods themselves. These internal data structures 
are therefore often unsuitable for use in small, resource- 
constrained devices in which class preloading is desirable 

65 and/or necessary. 

Moreover, if the internal data structures were individually 
modified to save memory space, the VM code would need to 
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be extensively revised to enable the VM to correctly access whether to modify the conventional representation of the 

the modified data structures. To make such changes to the data structure members. As a result, all emitted data struc- 

VM could be onerous and inefficient. ture information is consistent with changes in the internal 

Therefore, there is need for a modified representation of class representation. This automatic generation of consistent 

the internal data structures that is smaller in size than the 5 data structure information minimizes changes to the VM that 

prior art data structures, includes all information required by arc required whenever new classes are added to the VM, and 

the VM, and does not require extensive or onerous modifi- whenever class representations change. This provides a 

cation of the VM code. significant improvement over the prior art. 

The system of the present invention includes a collection 

SUMMARY OF THE INVENTION ]0 of class files, a Java class preloader in which the above 

In summary, the present invention is a method and system me ^ » ^P^ented and 1 output files generated by the 

that reduces the ROM space required for preloaded Java preloader including preloaded classes, header files and 

. source code files. 

The class files define the complete set of classes to be 

In particular, the method and system of the present JS preloaded ^ preloader performs a first pass on the class 

invention are based upon the realization that, in an environ- files to determine ^ different types of members of the 

ment where the Java VM classes are preloaded, it is highly mternfll daU stnictureS( 

likely that the VM would be a closed system with a set 4 . . - , . - , 

L r i j i . u c ij* distinct values of each type of member, 

number of classes and class components, such as fields and .7 _ _ 

methods. Such a closed VM would include a fixed number 2Q amount of rec l uired to store the values > 

of internal data structures, such as class blocks, method the size of the value indices, and 

blocks and field blocks. Moreover, each member of these the number of occurrences of each member type. 

data structures (e.g., a method block or field block member) The preloader then performs a second pass on the class 

would have one of a well-known set of distinct values. files and the internal data structures to determine how each 

Given this assumption and its implications, the present ^ member is to be represented, conventionally or as an index 

invention reduces the memory space required to represent to * value table entry, and then emits the appropriate output 

the internal data structures by: ^ ts - 

i > j 4 • • j * * * * 1 e 1 * rj A «„„i The output files are compatible with similar files 

1) determining distinct values of each type of data struc- , j •: *• 1 T ♦ « , . lU 

ture member* employed by conventional Java systems. That is, the pre- 

' - n loaded classes can be assembled or compiled into class 

2) determining occurrences of each data structure member 30 t ^ ^ ^ ^ ^ m&& ^ fee 

type (e.g., each occurrence in the method blocks of a compilcd ^ vm scmrccs into VM object data. The VM 

field block member type) and each occurrence's value; ^ class object dala can men be linked in ^ ^^0^ 

3) determining memory space that would be saved if each manner into the executable VM for a particular Java envi- 
occurrence were represented as an index to a table of ronment. 

values of the data structure member type rather than 35 

conventionally (storing the value for each occurrence in BRIEF DESCRIPTION OF THE DRAWINGS 

a general variable); and Additional objects and features of the invention will be 

4) if sufficient savings would result, allocating a value m0 re readily apparent from the following detailed descrip- 
table containing the distinct data structure member type 4Q tion and appended claims when taken in conjunction with 
values and configuring each occurrence of that field the drawings, in which: 

block member type as an index to the appropriate value p IG 1 illustrates the class file format common to the prior 

table entry; and art and tne pre sent invention; 

5) generating new sources to the VM so that its access to pyx; 2A is a block diagram of VM internal data structures 
the modified structures is adapted automatically. 45 used m the prior art to encode class, method and field 

In a preferred embodiment, the decision is made to information; 

represent a data structure member type as a value table index piG. 2B 'illustrates the data structure declarations that 

plus a value table if the following comparison is true: define mc format of thc VM intcmal data slructures shown 

(#occurrenccfl of typc)x(size of index)+(size of value in FIG. 2 A; 

table) <(#occuirences of type)x(size of general variable). 3U FIG. 3 is a block diagram of a distributed computer 

system in which the class preloader system and method of 

Once the present method has determined for each data ^ present inveDtion can be implemented; 

structure member type whether an occurrence of that type is nG 4 [& a Wock ^ of & execution ^ ^ lhe 

to be represented as an index into a value table or as a ^buted computer system of FIG. 1 in which the pre- 

general vanable storing the value, the present method emits 55 loaded claggeg ted b the class loader of FIG 3 m 

appropriate information for that type, mcluding accessor i oadcd j n t 0 ROM' 

functions, language declarations and source code that ini- „^ .„ ... 
tializes the value tables. Ine accessor functions are macros FIG ' 5 15 a A° w * a * ran ? illustraUng the Processing 
through which all runtime access to the data structure components used to produce the preloaded executable mod- 
members is accomplished-by the VM. Preferably, prior to 60 * 

emitting the above-described information, the present ™- 6 is a flow diagram illustrating the processing 

method determines the most compact arrangement of the components used to reduce the memory footprint of the 

value table indices, conventional representations of mem- preloaded executable module; 

bers and value tables and generates the value tables, value FIG. 7A illustrates the organization of the updated header 

table indices, accessor functions and classes accordingly. 65 file 614 of FIG. 6; 

The present method emits accessor functions, declarations FIG. 7B illustrates the organization of the value table 616 

and other data structure information after determining of FIG. 6; 
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FIG. 8A illustrates the organization of same member a compiler 122 for translating source code written in the 

occurrences and values after allocation in the execution Java programming language into a stream of bytecodes; 

engine ROM 208 in accordance with the present invention; a source code repository 124 including one or more 

FIG. 8B illustrates the organization of same member source code files 126 containing Java source code; 

occurrences after allocation in the execution engine ROM 5 a class file repository 128 including one or more platform- 

208 in accordance with the prior art; independent class files 130 and one or more class 

FIG. 9A illustrates the compact organization of a data libraries 131 containing class files, each class file 

structure instance with five members generated by the containing the data representing a particular class; 

present invention; a class preloader 132 that generates a set of preloaded 

FIG. 9B illustrates the organization of the data structure 10 classes 148 for a particular configuration of the execu- 

instance from FIG. 9 A generated by the prior art; tion engine (the class preloader is sometimes referred to 

FIG. 10 is a flow chart of the method used by the class as a static class loader); 

preloader to build the internal data structures used in the an assembler 134 that produces an object file representing 

preloaded classes; and 15 the class members, class data structures and memory 

FIG. 11 is a block diagram showing the mapping of a storage indicators in a format that is recognizable for 

preloaded application into read-only memory and random- me unker; 

access memory and indicating the loading of the portion of a linker 136 for determining the memory layout for a set 

the methods and data mapped into random-access memory of preloaded classes and for resolving all symbolic 

by a static class initializer. 2 o references; and 

DESCRIPTION OF THE PREFERRED °™ 0t ™? d f* ^ ^.^T " y ^ t^" 6 

cx/mnnTMCMT tne * P re l° aded classes 148). 

tMBUUiMWN i Note ^ ^ clags file repository c i ass preloader 132, 
The method and system described herein are directed to a assembler 134 and linker 136 need not reside on, the server 
Java class preloader configured to output preloaded Java 25 104 ( but can be on any computer whose output (e.g., files or 
classes that are optimized for storage in the ROM of a target messages representing the preloaded classes 148) can be 
computer (referred to herein as the execution engine). Given copied to the execution engine 102. 
that the execution engine is likely to be a computer with little Referring to FIG. 4, an execution engine 102 can include 
or no secondary storage, it is preferable that the Java class one or more processors 202, a communications interface 
preloader be implemented in a separate computer, which 3Q 206, a user interface 204, a read-only memory 208 and a 
shall be referred to herein as a server. Assuming such a random access memory 210. The read-only memory 208 
configuration, the preloaded classes could be transferred stores program methods that have no unresolved references 
from the server to the execution engine in a variety of ways an d program data that remains constant during program 
(e.g., network connection, direct communication link or operation. In the preferred embodiment, methods and data 
"sneaker net" transfer of readable media, such as floppy 3S stored in the ROM 208 include portions of Java applications 
disks or CDs). Accordingly., a preferred embodiment of the 212 and the execution engine's support procedures. These 
present invention described herein is directed to a computer support procedures include an operating system 213, net- 
system with a server and an execution engine wherein the WO rk access procedures 214, preloaded classes 232 and 
preloaded classes are generated by the server and subse- internal data structures 1200 (FIG. 2) used by the preloaded 
quently transferred to the execution engine for use in the 4Q classes 232. 

VM. The preferred embodiment is now described in refer- The random access memory 210 stores: 

ence to FIGS. 3 and 4. a second portion of the Java applications 215 and support 

Referring to FIG. 3, there is shown a distributed computer procedures 216, 217 that contain methods having unre- 

system 100 in which the present invention is implemented. solved references and data that is altered during the 

The computer system 100 has one or more execution 45 application's execution; and 

engines 102 and one or more server computers 104. In a one or more ^ a ta files 228 that the execution engine may 

preferred embodiment, each execution engine 102 is con- utilize during its processing. 

nected to the server 104 via the Internet 106, although other Referring to FIG. 5, there is shown a flow chart illustrat- 

typesof communication connections between the computers me sequence of steps used to produce a preloaded 

102, 104 could be used (e.g., network connection, direct 50 executable module. It should be noted that the method and 

communication link or sneaker net transfer of readable system described herein pertains to preloading a Java appli- 

media, such as floppy disks or CDs). Preferably, the server cal i on ^ otner support procedures. Any Java application, 

and execution engines are desktop computers, such as Sun or otner se t of methods that are normally linked at run 

workstations, IBM compatible computers and/or Apple (j me De preloaded using the method and system 

Macintosh computers; however, virtually any type of com- 55 described herein. 

puter can be a server or execution engine. Furthermore, the -j^e scmrce code 126 for each class that comprises the 

system is not limited to a distributed computer system. It j ava application is compiled by the compiler 122 into a class 

may be implemented in various computer systems and in g le i^0 9 w hich is a platform-independent representation of 

various configurations, or makes or models of tightly- me ^ass. As described in reference to FIG. 1, the class file 

coupled processors or in various configurations of loosely- 60 field and method tables, each method's bytecodes, 

coupled microprocessor systems. constant data and other information. Alternatively, the class 

The server computer 104 typically includes one or more files corresponding to the application can already reside 

processors 112, a communications interface 116, a user in-one or more class libraries 131. The entire set of class files 

interface 114, and memory 110. The memory 110 stores: t28 that constitute an application to be preloaded are trans- 

an operating system 118; 65 mitted to the class preloader 132. 

an Internet communications manager program or other The job of the class preloader is to generate the preloaded 

type of network access procedures 120; classes 148 for an execution engine 102 (FIG. 4). The 
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preloaded classes 148 include the class block 1202, method 
blocks 1204, field blocks 1214 and constant pool 1224 
described in reference to FIG. 2. Among other things, the 
class preloader 132 determines which methods and fields 
associated with each class 130 can be stored in a read-only 
memory 208 and which must be stored in a random access 
memory device 210. For example, methods that invoke Java 
interfaces or utilize non-static instance variables need to 
reside in random access memory. This is because the byte- 
codes that implement interfaces are determined at runtime 
and non-static instance variables are altered for each instan- 
tiation of the associated class. 

The class preloader 132 also performs a number of 
optimizations in order to produce a more compact internal 
representation of the executable code when that code is 
loaded into the execution engine ROM 208. For example, 
the class preloader 132 combines the constant pools asso- 
ciated with each class to eliminate redundancy in the internal 
representation of the class constant pool 310. In accordance 
with the present invention, the class preloader 132 also 
modifies the internal data structures 1200 (FIG. 2A) to take 
up less space in the ROM of the execution engine 102. It is 
an advantage of the present invention that this data structure 
optimization largely frees the internal representation from 
inefficient standard data structure formats 1200 used in the 
prior art. 

The preloaded classes 148 are transmitted to an assembler 
or compiler 134 that produces an object module 304 having 
the required format for the linker 136 to map the data into 
the appropriate address spaces. Preferably, there will be two 
address spaces, one for a random access memory device and 
a second for read-only memory device. The object module 
304 is then transmitted to the linker 136 which generates a 
memory layout for the classes in the application. Once the 
memory layout is determined, the linker 136 resolves all 
symbolic references and replaces them with direct 
addresses. The memory layout is partitioned into the two 
address spaces. The methods and fields that were flagged for 
read-only memory are included in the first address space and 
the methods and data that were flagged as requiring storage 
in a random access memory are included in a second address 
space. The output from the linker 136 is a preloaded 
executable module 306 containing the methods and data for 
these two address spaces. The processing flow of the present 
invention is now described with reference to FIG. 6. 

Referring to FIG. 6, there is shown a data flow diagram of 
the process employed by the present invention to reduce the 
memory footprint of internal data structures used by the VM. 
As already described in reference to FIG. 3, the class 
preloader 132 generates a set of platform-specific preloaded 
classes 148 from the class files 128. The preloaded classes 
148 are data structure declarations that can be declared in 
assembler source or by a high level language. An assembler 
134 or compiler 122 then converts these data declarations to 
object data 622. The class preloader 132 also determines the 
most efficient representation of the internal data structures 
1200 composing the preloaded classes 232. 

In the preferred embodiment a member of the internal 
data structures can be represented in one of two ways: 

1) as a generic memory word (e.g., of 32 bits) that is the 
value of the member; or 

2) as an index to a table of distinct values that can be taken 
by the member for each occurrence of the member. 

The first representation is the only representation used in 
the data structures emitted by the prior art class preloader. 
This representation can be very inefficient when a particular 
member for which hundreds or thousands of occurrences 
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exist only has a few distinct values. In such a situation, a full 
width memory word (e.g., 32 bits wide) is allocated for each 
of the occurrences, taking up as many as thousands of words 
of scarce storage in the ROM 208, even though only a few 
different values are stored. The second representation, which 
is employed by the present invention, solves this problem by 
generating a value table 616 to hold the definite values of 
such a member and generating for each occurrence of the 
member an index of only as many bits as is necessary to 
address all of the value table entries. The second represen- 
tation is advantageous when the memory that would be 
allocated for the indices and value table for a particular 
member type is smaller than the allocated memory required 
for the generic representation. The method by which the 
present invention determines how to encode the member 
data structures is described below, in reference to FIG. 10. 

Once the determination of how to represent the members 
is made, the class preloader 132 outputs for each member to 
be represented in the index+table format updated header 
information 614 (including modified member declarations 
and accessor functions enabling the VM 246 to access the 
modified member information) and a respective value table 
616. The header information 614 and value tables 616, 
which are generated as source code, are compiled by the 
compiler 122 along with the virtual machine sources 618 
that define the virtual machine to be executed in the execu- 
tion engine 102. The linker 136 links the resulting object 
data 620 and the object data 622 to generate the preloaded 
executable module 306, which can be loaded into the 
execution engine 102. One by-proudet of the present inven- 
tion is that, whenever new classes or members are to be 
incorporated in the preloaded classes 148, a new VM 246 
must be generated. This is because the corresponding header 
information 614 and value tables 616 must be compiled with 
the VM sources 618. However, because the present inven- 
tion automatically generates the header information 614 and 
member values 616 for any set of classes, generating the 
new VM requires no or minimal changes to the VM code. 
This is because the VM 246 always makes use of the 
accessor functions that are part of the header information 
614. Thus, the present invention is able to generate an 
efficient representation of data structure members while 
facilitating generation of the VM. 

The class preloader 132 is able to generate the efficient- 
index/table member representation because all possible val- 
ues of the members are known. As a result, the number of 
bits needed for each index is also known. The number of 
occurrences of each members is also known. Moreover, the 
preferred embodiment presumes that the class files 128 
represent the complete set of classes that are to be preloaded 
into the target execution engine 102. This presumption is 
especially applicable to execution engines 102 that are small 
handheld computers, which are unlikely to have the com- 
puting power and/or communications bandwidth to down- 
load classes on the fly in the conventional manner. Given 
that the number of indices and values are known and that 
there is no possibility of adding additional members or 
classes, it is possible for the class preloader 132 to arrange 
the indices to have an optimally compact or near-optimal 
arrangement when allocated by the execution engine 102. 
The class preloader 132 achieves this level of compaction by 
selecting the order of the indices in the updated header 
information 614. Referring to FIGS. 7A and 7B, there is 
illustrated the organization of the updated header informa- 
tion 614 and the value tables 616 along with specific 
examples of each data structure. These examples represent 
the outputs generated by the class preloader 132 correspond- 
ing to the data structure declaration 1230.N from FIG. 2B. 
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The updated header file 614 shown in FIG. 7 A includes a mtypel memberl_value[ ]") consisting of 400 values, 
set of data structure declarations 702, each of which can val 1, . . . val 400. Similar representations of the value tables 
include, in any combination, updated member declarations for member3 and member4 are also provided (e.g., in the 
704 and un-updated member declarations 706. Each data member 3 and 4 tables 7223, 722.4). 
structure declaration 702 corresponds to one of the data 5 Referring to FIG. 8A, there is shown an illustration of the 
structures used by the VM 246. The updated member manner in which the internal data structures(specifically, the 
declarations 704 are for data structure members that have member occurrences 802 and value table 806 for a single 
been modified by the class preloader 132 as index/table member type) of the present invention are organized in the 
members and the un-updated members 706 are for data execution engine ROM 208. Each of the occurrences rep- 
structure members that the class preloader 132 determined 10 resents one occurrence in a preloaded class of the same 
were best represented generically. Each data structure dec- member 802 and the data structure type 805 that encom- 
laration 702 is associated with updated member table dec- passes it (the data structure type 805 is likely to include 
larations 708, updated member accessor functions 710 and multiple members — e.g., see FIG. 2B ). Assuming that a 
un-updated member accessor functions 712. Each updated particular member has N distinct values 808, which are 
member table declaration 708 is associated with a corre- 15 stored in the value table 806, each of the M occurrences 802 
sponding value table 616 and declares that table in the of that member is allocated as an index 804 of width 
appropriate programming language. An updated member (|log 2 (N)|+l) bits to the entry of the value table 806 that 
accessor function 710 defines the accessor function for holds the member's value. For example, each of the occur- 
updated (i.e., index/table) members using the table name rences 802.1 and 802.6 is an index to the table entry 806.N. 
defined in the respective updated member table declaration 20 This entry 806 .N stores the definite value 808. N associated 
708. The un-updated member accessor functions 712 are with those member occurrences. Thus, the total memory 
unchanged from those generated by the conventional class usage of this model is M*(|log 2 (N)|+l)+value__table_j5ize 
preloader 132. bits per member. 

For example, FIG. 7A shows the updated header file Referring to FIG. 8B, there is shown an illustration of the 

information 614 for the data structure 1230 .N (Struct T) 25 manner in which the prior art organizes occurrences 852 in 

from FI G . 2B . This example assumes that the class preloader the execution engine ROM 208 of a particular member. Each 

132 determined that: of the occurrences 852 represents one occurrence in a 

1) memberl has 400 values and is best represented as an preloaded class of a particular member. Each of the M 
index/table member occurrences 852 of that member is allocated as a full-width 

2) member is best represented conventionally, 30 word 854 of the member for 

' , „ , , , . , , that occurrence, (i.e., each of these occurrences are repre- 

3) member3 has 200 values and is best represented as an scntcd m thc first format rcferrcd tQ above ) ThuSj thc total 

index/table member, memory usage of this model is M*32 bits (assuming 32-bit 

4) member4has 1500 values and is best represented as an memory words). As a result, the present invention saves 
index/table member, and 35 memory allocated for a particular member in the data 

5) memberS is best represented conventionally. structures when M*fllog 2 (N)|+l)+value_table_size is less 
Consequently, the class preloader 132 has generated a than M*memory_word_size (e.g., M*32). As in the 

modified "struct T" declaration 704 wherein memberl is example of FIG. 8A, the fields 802 are likely to be just one 

represented as a 9-bit integer index ml_idx (9-bits being element in a data structure declaration, 

enough to access 400 values), member3 is represented as an 40 Referring to FIG. 9 A, there is shown an example of how 

8-bit integer index m3__idx (enough to access 200values) the class preloader 132 of the present invention efficiently 

and member4 is represented as an 11-bit integer index stores in the execution engine ROM 208 all of the members 

m4_idx (enough- to access 1500 values). The other 802 of a particular data structure 902 (e.g., the members of 

members, member2 and member5, are left unmodified as the structure, Struct T 1230. N, FIG. 2B). Generally, the 

generic members of type mtype2 and mtypeS, respectively. 45 present invention packs the stored values (i.e., the indices 

The class preloader 132 has also generated an updated 804) so that they occupy as much of a fixed length memory 

member table declaration 708 for memberl showing that the word as possible. In the illustrated situation, the memory 

memberl values are stored in a value table (memberl_ words are 32 bits wide, but the present invention is appli- 

value[ ]) of type memberl. The memberl_value table is cable to memory words of any length. In the example shown 

declared as an external variable (extern), which tells the 50 in FIG. 9A, the 9-bit, 8-bit and 11 -bit members ml, m3 and 

compiler 122 that the actual values of the table are defined m4 from Struct T 902 are packed into a single 32-bit 

in another file, in this case the value tables file 616. Similar memory word. Values of the members m2, m5, which are 

updated member table declarations 708 are generated for represented conventionally (e.g., as 32-bit values), are stored 

member3 and member4. in respective 32-bit general variables following the first 

The accessor function 710 for the updated memberl is 55 word. In the preferred embodiment, these conventionally- 

correspondingly modified so that each time the correspond- represented members must be aligned on word boundaries 

ing accessor function, memberl of (T), is invoked the VM (e.g., every 32 bits). There is no such requirement for the 

246 that accesses the preloaded methods uses the memberl modified members. Therefore, for each data structure 

value (i.e., the 9-bit ml_idx) as an index into the instance there are only 4-bits of unused space 904 between 

member Lvalue table. The accessor functions 710 for the 60 the fourth member m4 and the first general variable m2. The 

updated member3 and member 4 are modified in similar class preloader 132 aims to pack the members of an internal 

fashion. data structure into memory words as efficiently as possible 

Referring to FIG. 7B, there is shown a representation of given any combination of member representations and mem- 

the value tables 616, including a table 722.1 that defines the ber sizes. 

definite values that can be taken by the memberl_value 65 Referring to FIG. 9B, there is shown a diagram illustrat- 

table declared in the header file 614. In this case, the ing the format of the same data structure Struct T as stored 

memberl__value table is defined as a constant array ("const by the prior art class preloader. Note that, in this system, the 
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data structure requires S words to store the 5 members. Thus, (1124-N), the class preloader will represent that member 

the prior art is far less efficient then present invention (which type conventionally (1128). 

only needs 3 words to store the same data structure The class preloader 132 repeats the steps 1120, 1122, 
information). The method of the present invention is now 1124, 1126, 1128 while other members remain to be pro- 
described in reference to FIG. 10. s cessed (1124-N). 

This arrangement presents no problems to the preloaded , 0nce each m f£ ber J* 5 been processed (1124-Y), the 

classes' use of the accessor functions as the different class preloader 132 performs a data structure declaration 

memory locations of the indices 804 are resolved by the generation procedure 1130 In this procedure, for each data 

compiler 122 and the indices themselves store the index of structure the class preloader 132 determines the optimal 

their associated value 808. 10 ordering of the data structure members (1732). The ordering 

Referring to FIG. 10, there is shown a flow diagram of the P rocess and its considerations have already been described 

method of the present invention implemented in the class »» reference to FIG. 9A. The class preloader 132 then 

preloader 132. The present method is implemented in two generates the member header informaUon 614 and values 

passes, which include an accounting pass (represented by 616 m accordance with the optimal ordering (1134). 

the box labeled 1104) and a data structure declaration 15 generation of the header informaUon 614 and member 

generation pass (represented by the rest of the steps). As the values 616 has been described in reference to FIGS, 

first accounting step (performed for all internal data ^ ^ 7B. 

structures), the preloader 132 identifies all member types of Referrin 8 ,0 nG - u > preloaded executable module 

an internal data structure (1106). For example, referring to and boot «™e mltlator 1320 permanently stored in the 

FIG. 2B, the five members of Struct T are that data struc- 20 read-only memory of an execution engine computer. Each 

hire's member types. For each member type, the class Iime me execution engine computer is powered on or 

preloader 132 then performs the following processing: rebooted . ,he 0001 ^ mitiator 1320 ». automatically 

. , ., „ _, , „,„o\ executed. Among other tasks, the boot time initiator copies 

Identify M occurrences of the member type (1108). ^ ^ ^ ^ ^ be fcsidcnt [n rmdQm ^ 

Identify N values of the M occurrences (1110). ^ me mory during execution to the random access memory 

Determine the memory space needed to store each value locations assigned to them by the linker. 

(1112). Although the method and system described herein have 

Determine the memory space needed to store an index been described with reference to the Java programming 

that can address the language the present invention is applicable to computer 

N values (the index must be at least |log 2 (N)|+l bits) 30 s y stcms other object-oriented classes that utilize 

HIM). dynamic runtime loading of classes. 

_ . ' , . , , - Further, the present invention is amenable for execution 

Determine *e size of the conventional representation of qu ^ of ej£ecutable mediums other ^ a 

the member occurrences (1116). me deyice ^ M a random access me 0lher 

This processing lS performed on all members of all t ^/ fexecut ^^ 

internal data structures! before proceeding with the steps 35 J*^ & computer-readable storage medium, which can 

startmgwith box 1118 ^. This order of processmg is preferable be me ^ c{ dis Qr fl ^ 

I' k C g I gen ? ra b f P' occdur f 10 The aforementioned system and method have been 

the box 1104 are used by Uie subsequent second pass steps, ^ tQ fl ic Jflva Uca . 

TVpicaUy, the accounting statisUcs are stored temporarily for ^ ^ are lQ ^ Jaya applicatioiL For example) 

use in the second pass. mc prcscnt invention could be employed to preload classes 

Once aU of the statistics have been generated, the class ^ a ^ m mdg6 m Java 

preloader 132 computes for each member type: k ^ {Q £ n Qn a handhcld computcf Moreovcrf ^ Java 

the memory space (LHS) required by the conventional application need not be run in a distributed environment, it 

representation of the member occurrences (1120); and ^ can ^ in sta nd-alone mode executing in a execution engine 

the memory space (RHS) required by the novel represen- or server computer without importing new classes from 

tation of each member occurrence as an index to a value external systems. 

table (1122). While the present invention has been described with 

The class preloader 132 computes the LHS value in step reference to a few specific embodiments, the description is 

1120 as follows: so illustrative of the invention and is not to be construed as 

limiting the invention. Various modifications may occur to 
these skilled in the art without departing from the true spirit 
; ; ~~ " and scope of the invention as defined by the appended claims 

LHS - (size of the conventional representation) x no. or occurrences . - . - „ c , 

- (siz« of the conventional representation) x M bits. In "g ht of thcir M of equivalence. 

5S What is claimed is: 

1. A method for reducing memory footprint of preloaded 

The class preloader 132 computes the RHS value in step classes t0 be incorporated into a runtime environment, 

1122 as follows: comprising the steps of: 

determining types of data structures represented in one or 

60 more class files used to define a plurality of preloaded 

RHS = (size of the member value) x no. of occurrences + size of the classes, the plurality of preloaded classes having an 

value table associated total memory footprint, each of the data 

- (size of the member value) x M + M x (|log 2 (N)| + l) bits. structure types including one or more members; 

determining distinct values that can be taken by the 

If the RHS is smaller than the LHS (1124-Y), the class 65 members; 

preloader 132 represents that member type as a value table selecting values, from amongst a set of the distinct values, 

and indices (1126). If the RHS is not smaller than the LHS that are mathematically determined to satisfy a total 



04/12/2004, EAST Version: 1.4.1 



US 6,658,492 Bl 



13 



14 



memory footprint reduction requirement, wherein the 
total memory footprint reduction requirement is satis- 
fied by a respective value only if a reduction in the total 
memory footprint would result by representing occur- 
rences of the respective value as an index to a storage 5 
structure shared amongst the plurality of classes, and 
wherein satisfaction of the total memory footprint 
reduction requirement depends, at least in part, on a 
size of the shared storage structure; 
storing each of the selected values in the shared storage 10 
structure; 

generating a set of value indices for addressing stored 

values stored in the storing step; and 
generating accessor functions and member declarations 

that enable the runtime environment to use the selected 15 

members represented as the stored values and the set of 

value indices. 

2. The method of claim 1, wherein the subset of the 
members selected to reduce the size of corresponding inter- 
nal data structures are selected using the following steps: 
for each of the members of a data structure: 
counting occurrences of the member in the runtime 
environment; 

determining a storage size needed to store the distinct 

values of the member; 
determining an index size necessary to fully index the 

distinct values; 
determining a conventional size needed for a conven- 
tional representation of the member; and 
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data structure declarations configured to minimize the 
total memory footprint of the preloaded classes when 
allocated in memory; 

the class preloader being configured to generate the 
internal data structure declarations so that each of a set 
of selected data structure members are represented as 
an index to a storage structure holding distinct values of 
the selected data structure member; 

wherein the class preloader is configured to select data 
structure members that are mathematically determined 
to satisfy a total memory footprint reduction 
requirement, wherein the total memory footprint reduc- 
tion requirement is satisfied by a respective data struc- 
ture member only if a reduction in the total memory 
footprint would result by representing the respective 
data structure member as an index to the storage 
structure, and wherein satisfaction of the total memory 
footprint reduction requirement depends, at least in 
part, on a size of the storage structure. 

10. The system of claim 9, wherein the class preloader is 
further configured to generate accessor functions and mem- 
ber declarations that enable the runtime environment to use 
the selected data structure members even though they are not 
represented conventionally. 

11. The system of claim 9, wherein the class preloader is 
configured to assign membership in the selected data struc- 
ture members to particular data structure members for which 
a conventional internal representation of the particular mem- 



ber's occurrences would occupy more space in the memory 

selecting the member as one of the subset when 

3 30 than a like number of indices to entries in a storage structure 

second product equaling (the occurrences times the holding the distinct values of the particular member's occur- 

index size) plus the storage size is smaller than a first rences. 

product equaling the occurrences times the conven- 12. The system of claim 11, wherein the class preloader is 

tional size. configured to determine an optimal arrangement of the 

3. The method of claim 2, wherein the step of generating 35 members of a particular data structure that minimizes size of 
the set of value indices comprises: an occurrence of the particular data structure. 

for each of the data structures, determining an optimal 13. The system of claim 12, wherein the class preloader 

arrangement of the members that minimizes size of an is configured to generate the accessor functions and member 

occurrence of the data structure. declarations in view of the optimal arrangement of the 

4, The method of claim 3, wherein the step of generating 40 members, such that the runtime environment can access the 
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accessor functions and member declarations takes into 
account the optimal arrangement of the members, such that 
the runtime environment can access the value of a particular 
member occurrence via a respective accessor function even 
when the corresponding member has been repositioned in a 45 
respective data structure in accordance with the optimal 
arrangement. 

5. The method of claim 1, further comprising the step of, 
when new classes are added to the runtime environment, 
repeating the steps of claim 1 to generate a new set of 
internal data structures that will require no modification of 
the runtime environment code that accesses the internal data 
structures. 

6. The method of claim 1, wherein the preloaded classes 
represent the complete set of preloaded classes composing 55 
the runtime environment. 

7. The method of claim 1, wherein the runtime environ- 
ment is a Java virtual machine. 

8. The method of claim , wherein the runtime environment 
is executed in a handheld device. 

9. A system for reducing the memory footprint of pre- 
loaded classes to be incorporated into a runtime 
environment, the preloaded classes having an associated 
total memory footprint, the system comprising: 

a set of class files; and 

a class preloader configured to generate from the class 
files a set of preloaded classes and a plurality of internal 
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value of a particular member occurrence via a respective 
accessor function even when the corresponding member has 
been repositioned in a respective data structure in accor- 
dance with the optimal arrangement. 

14. The system of claim 9, wherein the class preloader is 
configured to choose the selected data structure members 
according to the following steps: 

for each of the members of a data structure: 
counting occurrences of the member in the runtime 
environment; 

determining a storage size needed to store the distinct 
values of the member; 

determining an index size necessary to fully index the 
distinct values; 

determining a conventional size needed for a conven- 
tional representation of the member; and 

selecting the member as one of the subset when a 
second product equaling (the occurrences times the 
index size) plus the storage size is smaller than a first 
product equaling the occurrences times the conven- 
tional size. 

15. The system of claim 9, wherein, when new classes are 
added to the runtime environment, the class preloader is 
further configured to generate a new set of internal data 
structures in accordance with claim that will require no 
modification of runtime environment code that accesses the 
internal data structures. 
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16. The system of claim 9, wherein the preloaded classes 
represent the complete set of preloaded classes composing 
the runtime environment. 

17. The system of claim 9, wherein the runtime environ- 
ment is a Java virtual machine. $ 

18. The system of claim 9, wherein the runtime environ- 
ment is executed in a handheld device. 

19. The system of claim 9, wherein the storage strucnire 
is a table. 

20. A computer program product for use in a computer 10 
system for reducing the memory footprint of preloaded 
classes to be incorporated into a runtime environment 
executing on an execution engine, the preloaded classes 
having an associated total memory footprint, the computer 
program product including a computer readable storage 15 
medium and a computer program mechanism embedded 
therein, the computer program mechanism comprising: 

a class preloader configured to generate from a set of class 
files the preloaded classes and a plurality of internal 
data structure declarations configured to minimize the 2 o 
total memory footprint of the preloaded classes when 
allocated in memory of the execution engine; 

the class preloader being configured to generate the 
internal data structure declarations so that each of a set 
of selected data structure members are represented as 25 
an index to a storage structure holding distinct values of 
the selected data structure member; 

wherein the class preloader is configured to select data 
structure members that are mathematically determined 
to satisfy a total memory footprint reduction 30 
requirement, wherein the total memory footprint reduc- 
tion requirement is satisfied by a respective data struc- 
ture member only if a reduction in the total memory 
footprint would result by representing the respective 
data structure member as an index to the storage 35 
structure, and wherein satisfaction of the total memory 
footprint reduction requirement depends, at least in 
part, on a size of the storage structure. 

21. The system of claim 20, wherein the class preloader 

is further configured to generate accessor functions and 40 
member declarations that enable the runtime environment to 
use the selected data structure members even though they 
are not represented conventionally. 

22. The computer program product of claim 20, wherein 
the class preloader is configured to assign membership in the 45 
selected data structure members to particular data structure 
members for which a conventional internal representation of 
the particular member's occurrences would occupy more 
space in the memory than a like number of indices to entries 

in a storage structure holding the distinct values of the 50 
particular member's occurrences. 

23. The computer program product of claim 22, wherein 
the class preloader is configured to determine an optimal 
arrangement of the members of a particular data structure 
that minimizes size of an occurrence of the particular data 55 
structure. 

24. The computer program product of claim 23, wherein 
the class preloader is configured to generate the accessor 
functions and member declarations in view of the optimal 
arrangement of the members, such that the runtime envi- 60 
ronment can access the value of a particular member occur- 
rence via a respective accessor function even when the 
corresponding member has been repositioned in a respective 
data structure in accordance with the optimal arrangement. 

25. The computer program product of claim 20, wherein 65 
the class preloader is configured to choose the selected data 
structure members according to the following steps: 
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for each of the members of a data structure: 
counting occurrences of the member in the runtime 
environment; 

determining a storage size needed to store the distinct 
values of the member; 

determining an index size necessary to fully index the 
distinct values; 

determining a conventional size needed for a conven- 
tional representation of the member; and 

selecting the member as one of the subset when a 
second product equaling (the occurrences times the 
index size) plus the storage size is smaller than a first 
product equaling the occurrences times the conven- 
tional size. 

26. The computer program product of claim 20, wherein 
the runtime environment is a Java virtual machine. 

27. The system of claim 20, wherein the execution engine 
is a handheld device. 

28. The computer program product of claim 20, wherein 
the storage structure is a table. 

29. A runtime environment built from a collection of 
preloaded classes defined by one or more internal data 
structure types, each including one or more members, the 
preloaded classes having an associated total memory 
footprint, the runtime environment comprising: 

a storage structure holding distinct values that can be 
taken by at least a subset of the members; and 

an index to a storage structure entry holding the distinct 
value of a respective member of the subset of the 
members serving as each occurrence of the respective 
member with the distinct value; 

such that the runtime environment determines when nec- 
essary the distinct value of the respective member by 
retrieving contents of the storage structure at a location 
defined by the index; 

wherein a plurality of the distinct values held in the 
storage structure have been mathematically determined 
to satisfy a total memory footprint reduction 
requirement, wherein the total memory footprint reduc- 
tion requirement is satisfied by a respective value only 
if a reduction in the total memory footprint would result 
by representing occurrences of the respective value as 
an index to a storage structure shared, and wherein 
satisfaction of the total memory footprint reduction 
requirement depends, at least in part, on a size of the 
storage structure shared. 

30. The runtime environment of claim 29, wherein all of 
the distinct values are known and the index to the storage 
structure entry is implemented using fewest bits able to 
index all of the distinct values associated with the respective 
member. 

31. The runtime environment of claim 29, wherein occur- 
rences of the members not included in the subset of the 
members are implemented as fixed-length values of the 
members. 

32. The runtime environment of claim 31, wherein the 
runtime environment is a Java virtual machine (VM). 

33. The runtime environment of claim 29, wherein the 
storage structure is a table. 

34. A method for loading an execution engine with 
preloaded classes to be incorporated into a runtime envi- 
ronment to be executed on the execution engine, compris- 
ing: 

downloading into the execution engine the preloaded 
classes, including a plurality of internal data structure 
declarations composing the preloaded classes config- 
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ured so that each of a set of selected data structure 
members is represented as an index to a stored distinct 
value of the selected data structure member, the set 
being selected to minimize a total memory footprint 
associated with the preloaded classes when allocated in 5 
memory of the execution engine; wherein each member 
of the set has been mathematically determined to 
satisfy a total memory footprint reduction requirement, 
wherein the total memory footprint reduction require- 
ment is satisfied by a respective member only if a 10 
reduction in the total memory footprint would result by 
representing occurrences of the respective member as 
an index to the stored distinct value of the respective 
member, and wherein satisfaction of the total memory 
footprint reduction requirement depends, at least in 15 
part, on a size of a storage structure configured to store 
the distinct value of the respective member. 

35. The method of claim 34, wherein the preloaded 
classes are downloaded over the Internet. 

36. The method of claim 34, further comprising: allocat- 20 
ing the preloaded classes in the memory of the execution 
engine. 

37. The method of claim 34, wherein the runtime envi- 
ronment is a Java virtual machine (VM). 

38. The method of claim 34, wherein the execution engine 25 
is a handheld device. 

39. A method for generating and loading into a client 
preloaded classes to be incorporated into a runtime envi- 
ronment to be executed on the client, comprising: 

generating in a server the preloaded classes, including a 30 
plurality of internal data structure declarations com- 
posing the preloaded classes configured so that each of 
a set of selected data structure members is represented 
as an index to a storage structure holding distinct values 
of the selected data structure member, the set being 35 
selected to minimize a total memory footprint associ- 
ated with the preloaded classes when allocated in 
memory of the client; and 

downloading into the client the preloaded classes; 

wherein each member of the set has been mathematically 
determined to satisfy a total memory footprint reduc- 
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tion requirement, wherein the total memory footprint 
reduction requirement is satisfied by a respective mem- 
ber only if a reduction in the total memory footprint 
would result by representing occurrences of the respec- 
tive member as an index to the storage structure, and 
wherein satisfaction of the total memory footprint 
reduction requirement depends, at least in part, on a 
size of the storage structure. 

40. The method of claim 39, wherein the preloaded 
classes are downloaded over the Internet. 

41. The method of claim 39, further comprising: allocat- 
ing the preloaded classes in the memory of the client. 

42. The method of claim 39, wherein the runtime envi- 
ronment is a Java virtual machine (VM). 

43. The method of claim 42, wherein the client is a 
handheld device. 

44. A method for reducing the total memory footprint of 
preloaded classes to be incorporated into a runtime 
environment, comprising the steps of: 

determining distinct values that can be taken by members 
of internal data structures composing the preloaded 
classes; 

selecting values, from amongst a set of the distinct values, 
that are mathematically determined to satisfy a total 
memory footprint reduction requirement, wherein the 
total memory footprint reduction requirement is satis- 
fied by a respective value only if a reduction in the total 
memory footprint of the preloaded classes would result 
by representing occurrences of the respective value as 
an index to a storage structure shared amongst the 
plurality of classes, and wherein satisfaction of the total 
memory footprint reduction requirement depends, at 
least in part, on a size of the shared storage structure; 

storing each of the selected values in the shared storage 
structure; and 

replacing each occurrence of a subset member with an 
index to the value of that occurrence, enabling the value 
of that occurrence to be retrieved via the index. 

* * * * * 
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